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(54)ntte: IMAGE COMPRESSION WITH COLOR INTERPOLAITON FOR A SINGLE SENSOR IMAGE SYSTEM 



(57) Abstract 



In accordance with the 
present invention, the R, G, B co- 
lor image signals from a single 
sensor having a color filter array 
are all transformed to T-space by 
changing them to Ri^r QUr^ 
Bi/r respectively, where T is ap- 
proximately 2.4. In this space, all 
operations such as color differen- 
cing, interpolation of those miss- 
ing pixels required for color dif- 
ferencing, compression, decom- 
pression, edge enhancement and 
final interpolation of all missing 
pixels are performed without fur- 
ther transformation of the image 
signals. For the same final bit 




rate;, noise in the reproduced im- 
age is reduced by refraining from 

interpolating the missing color pixels prior to compression of the image data. In order to avoid over-emphasizing features of the 
image which are already sufficiently sharp, the combined outputs of horizontal and vertical sharpening processes are subjected to 
a panng process of the invention which suppresses strong high-spatial frequency components as a function of their amplitude. In 
the compression-decompression process of the invention, each spatial frequency coefficient of the spatial frequency-transformed 
unage is divided by a normalization factor determined by cascading in the spatial frequency domain the human visual system 
contrast sensitivity function, the edge enhancement modulation transfer function and the image display modulation transfer func- 
tion and inversing the resulting matrix elements. 



2WS««'*ia(::F^I»55«-r 4 Z i A- ^ * ft JSfflODinxeSR 1 Jt»^&i, 

fli & a c; » fe a xs < c>4 r -5 a f& ^ r s w js »a *■ # ( : »» to s -s * F*i 

'J > r i 7 ^ ^ > . 

6« t. <i 5 c i ft i r 4 aa« 



?i? ^¥5-505084 (2) 

1 oiEaft«a*wittjr5jsffi^at, 



1 3. 1 2 twse«$nA:SK-u*-» T, i^scm^Sfc T±fiE^rn/iSi 
M a (c *4 «; s B5 sSiE a f t e w fiE 4 * 4 ^ a 

t- S jfe » * 3t5i r 5 « /Ti ^a <0 S« GiS M» O i &« tt t ^ Wit S -tf - 

nie 3( ^ ^a 1^ 1^) fc; r 4 »flgn ^ en £2 MA «c ft K A s 3 0 o 

'^TY 7;Ht*rt]£r iefc^^ai* Plffi*/c*)ot>f ^vu4s<.^-c»^4JC-^4!Efia 

-t-nrcjioT, APfl*oa)t=i ^h-^xh-t^^-j^^ f-r^-f fleet iE?'J«-?tJ fit r 
-sft^fiE^ai, 



iSE (ft fit s» r 4 Rtt ^a*< , 

17. 1 5 (cE«*nfc»«T* oT, B:fI2jFIta#a*<ai2 *fcti» 3A 

tt:5>i'5;^nr>->x-f ir7^<M»i0^j»tt*:i*'>* **4«:P^a«-St;::> 

19. aiJR^Si 7(;Kll?nfcS«T*->T, z ::-ciaES(2&a»3A;^»? 
•S.7 T 9 9 am 2 K-tyft'7 - . -r- ^ s-pti 2i^f£r>^ »3X«^ ^ - * 5*- 

E-r(4 4 t Ci4 C i«-«»i:r 4SEa. 

20. a^Rja 1 1 icje«*nftf5K-p*^Trs c ^-ca:snai*tt«tt'^oiRses 

i tw»ir 4aK. 
2 1. B«<t)£yt)^ at.'tB«7=-^'*-iS5tfEr 4aaT*-,r, 



ffi j£ iT.j« {tis ft «-« 7^ ft -r 5 61 $ c :i i €-4^ a t r i K a, 
^-r%;£a. 

2 4. in?)CJ5 2 3*=Eil^n.r^aHT'AoT:, c CTgyxe/? :^ 

wfi ic « (t. r £ sii s£iF-)a ftiE *.fiS r 4 * s 

(r)&X^*7(OV ^ y A^tSffriksE-t ^^&t, ffi«SO«>^-f ^ -'Hc JB V *x M I^^■r 
4 ffi M « iS ft T? X ^ ^ i iM B * & © fi tt £ iliW » o 16 IS i & K ti i *M ifi 



?^ ^¥5-505081 (3) 

R"C*-»T, f-ntc J: 9, Wit" > ^ V 7. y -tr-^ i^r 1 t"-?-^ M 8t iC ?>! f > 

tst^ci^ftifti-rsaa. 

2 6. .•sitJi2 2i;K«?nfcaa-c*-5r, z crfl3xef*fi^a**B^KiE«ft 

2 7. »^a2 5uie«*n/=«a-c* -»-c, c c-rinie/EW*<^ t-n^^n, r> 
2 8. aiJ3».)3t2 7ic;da«nf=st«T?*->T. c c ^rsaKAi* a 

2 9. :jI*JS2 7t;22B* n/zSar feoT, C w-r«iKfe«JS5e-d**a^ -< 
SjtfeT-f :^5^Bfed^ 5) -C(i 2 4l <i 5 , ff fe -r >f :^ feBli^ IT (i 4 t 4 Z 4 

30. 3I^j5 2 ] i^:eft*nf:sa-r* w(= tiv.^r£Bi)aafettC^ttusc 

»r 4BiJe?a**B^K«tt3^<>ffffl*>I*g??Tri^»«ra^. C :: Jrfcv- 



« w <o w ;5 ?ii €■ ^ii£r 5/: *6 JAiiia 7 -f /i/i^ >*rr s-f-Si. 
a w <b ^- f5» i -r 4 3S a, 

33. Bi3jffli3 1 tri;«3nta«T* ^ t:, ii9ae3 £<oe«t7?M,t: t-^ic^ii- 
1 fttt^ai. 



r3SBHB*S«'*ne*n, MJB-r 4 i ir J: ^r, -tfv^^nro^i.Ji*sn<5» 2 St/ 

7®^ff$iS.r4/i»ic£itt-r 4^ai i:€-**ai-<-s «a* 

3 5. iS*J53 4i-Kifc*n/i»aT*^r. c c-cmiea«a;5'« ^> - * 

SaTfe 0 , rA<|ft)2. 4 T* i i ^-WaiT 4 «a. 

3 7. msftJB 3 4i;£ett5n/^aa-c*or, c c-rffiKHiis^aa*, 

4 ) Sjie^ - KItir-v h t^flXT4 =1- Kft^a. 
3 8. »*gs3 7t=jaK#n/^:16a-r*-.x, ;: -irfei^-r*2W)«tettfttt^: 
sgie^pty- KSnyiK«Gj»MKu34JCr 4iEKftE«*i«r i^&i. 

fRi ;£c?3 IE « f tK?'J tc ?4 Ei-r 4 g ft J: ^ T s 2i5!a &e a * » r 4 iE» (t * 

3 9. ,T»-1?J5 3 8i^J2»l5n/::KHT * -^r. JWK/S ;^ '/ - K * n/ifi«GaM 

as*, v?kJBS?ais««^a'ai'^>««tKiafwa(-«Jcr 4 c t t««ir 
4«a. 



in 28 s a a m s s i:: M i& r s Ksgiti • e 11? x£ 3! rsi a «E ^ & » % ^2 ^ A ^ 

3<75A^W7 - • -r- ^ffi^-ffiWr 5 i *t:;. V t 7 ?-rAfJliO» 
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44. a:^9 4 2i-:e«s n/risa-cft ^ T, z zicuv'-ciTjiejB 2&a» 1 A 

ZiCiiV^r, Syieflfi^irs^ 77^'J«r*J52A;0ri5---r-:?'ffiTtl2t?i>3, JR 

je&£ rji« at e «f » * » >7c 4 ? a . 
4 7. n)3^t«4 6iceK* nfctEai-c*->-c. ^ crf3JEa^*a)&«, 

ft It -r i»r s >!> *ci iE a ft ^-a i * 

48. »:Rqi4 7(iKK?nf:S5aTJ&^T, C Cic ii^^-THtlie ^ Y - K$ n 

^ » « EciSM e* tr >♦ rt;r « :i t s-^ tt i s « «. 

nfc««B5i«MjaJ><AIBIOBl«:> 3 > h 5;^ Hr > >-P-r e?-^MK<cirf 



IV? W £c j;i M tt tc it t- »S «i 6^ ^ ITf C £ ift & « tt o ft «C ^ ^ 
Si, 

5 2. IlljRJ«5 1 *n/;35aT*^r. w C U V* xSIieKEiJcoei w*^^ 

ii'x«iE«(tEy^*3-«Er'5 c i t«ait- 4»a. 



figci:- Kicav*. 3- Ka^s^atst.':: i^wa^ 

^5»a, 

iifiiie J a<?5a«® r2wsii**t.'a i /ewa ^ - ■ ?ffi€^«J5£ 

tst*; i***aif 
5 6. a*-gi5 5icKtEi*nAisa-t?* ^T, ; i:J3t^TsgEiS(»ao»<^ ^- 
c-^ t*#5air 4S5«. 



58. Oiiii^'^'ytztensritiitxr^^-^'c. - c icfc»,*rjPiiesc»¥a6*iri52 

-^.^ , M y-srijp r^PZiistti'aMlP.S 2S:C/sB 3f*S^^ ^-©O 

60. a-ltJ^^ y :rE«Snn«H-r*.-.T, iTIKitS^ft*^. 
^ feSfff ^ 03 ^'^ w»i m * n /- r «S * tt » r 4 S5 2 Jt ^- a i , 

i « a a *o r ^ M IB 18 * a 1= I* *a * ^- ® ^ - 
gU«»2HJ?¥&A*. 



^2 ^?-5-505084 (5) 

s c - i « ffi ». t r -6 s at . 
less J di^jrt 3- . «ifij'^ rsws»B«oaie«?'j*w«i«ia7 ^ 

pfl a *fe * w * * a <i: > 
ft* * t w «b **sffl i i aa- 



I : J: r ^ tE J« f t * n ^ S m P9 is £i tt ^ J* * ^ * ^ ^ * ^ ^ ' 

)|?«tn5- • 7=— i'S^a^fitS ti-iiH^Eft^Si'- 
ir ^ 5 C i * «f » i -r SSa. 

6 7. B|3j^^6 6lcKiS^FnfcSB-fA-r, lE.ciEStSt^ ©l- -t -> r^^S ? ti" 
69. 2ff,1tr56 8i=;etE^n/43EH-e^-,T. S (CfiiS/; ;^ ^ - K S nfi ifi«£ 



as ft « e it M » R ?i *• i»5 EE t- 5 ¥ a t , 

70. a;}^jji69icse«?n/.«a^*->-c. «<r, Risffw^RA^iPiiEi'^s* 2 
tt * j;£ffi 4 ^9^* iS ^ s * ^"^^ ^ * *^ ^ ^ * * 

2) 3^iei«s*nfci£j3ift«&^rs e«[ti:^^a*^-#-'»^^- 



— 5 — 



inter; x^ - n/:fi«icifMtt(cHlt-ritt»Eff5iEJflfbT' T ? ^t-sr * 

■76. wstJS 7 5*::re«*n/t«a-e* ^T, !B)ceaai£a;»¥ar^fiJc$ nr- 
B**^t;e«<-i y^ar i^eii, Riej^-s- v«a¥aTifefiE?<i-fre* 

77. a3iJS7 6(cffi«*n/:SKT*-,X. c Ciirfc-i'TTME^:^'^ - K^rn 

78. a^jfja 7 7 icie«* n^cssH-c* o r, c c tei-rs^K^ x v - k5 n 
K« EiS M» I- It r * leiE a ftKyij t^fiE ? ^ s ^ a , 

KX ^ a JJ* e ^ 4 S« ^ - V > r 6- ^. iraS2SMJS9 ifr tt « » m ritStAf 
JS9jfe Steffi* (Ki*M»w«tttSff.tt^-M*$tf. -tnjcjiO. 



?^a¥5-505084 (6) 
s^iea M it- r s aE« .=»ffujes nna ttK fio att ^fi « flc ^ ^ o 

TAWioattr > h5anf>->7-< fcr-?-/Maff>a5tti s-Ktfe*M**-e. ^• 

80. a4J^7 9(CK«tS^./c«a-C*r,T, BKB3tM«a!P502m'<7 - >»< 
82. M*:a7 4lcie«*n/cSK'P*^T, ^Ctcfc-t^-c, MK<oiS^^iE«ft 



Mfe) icnaLJ'D;-^>X Cchromi nan ce) MilfiEiJ < W^tf. & 
t i m a B e r ) JiBI0W^> teefflrnif, ■«^:^'^^■tz:^^- •T7.,/tiP'rt"<' 



*e.ifire.) t-sfs^*^ -5 tzt^* w^tif, staio j?^- * 7 -r /i- 
X Mie is « «- xt i w t c ± -c ± * n /; fff /7 5 - s » H snr 6 i* 

ni, Z<r>f5i£,it (£. f Lti ± TO ffi«r)dl'>*«-«KT tin* 1.^*0 . ^OlttBriffi 

log R/G-log R-lo« C 
log B/C-toX B-los G 

A -7 -a«r3^J&a;i?^tc-^v.T(i 1939^7^24 BicYusHenj T.Tsai. 
Kenneth A. Parutskl Rt/Haj id B«Jbban i T > > A, • -t > ■^^ - 9 - • -< y 

»^No. 384. 3 5 3 i;Ktl*nxi^« AN -nil*ftBfl®aiSAlw»«* 

nn**. ?imd n^^ajwicti. ffl«ffi«i>x f-^icfct^r j:K<o:^pftAfic<o j: 



— 6 — 



<?5f^»«iJ«i:/ti-^a:aA'Ma^frLTV'i. DiifttEai > scoii J. D 

4. 7 8 0. 7 6 1 i^««*nr».^i-t. -^iw, M«fE-^«^^r-iR^isafi£'/*^-'7; 

c^-^-carA^n-sifiBtEiSflaeii^*. nia • <»ftteai^^ 5 a«f^^>^- 
^ * n«=ia'^si-(i;»«^^'*-^^ - <!="c■**• 



1^ a ¥ 5-505084 (r) 

coy xtaar 5tffsj;><*i. 

o i » « a » K * a » 9^ ic w « f 4 c <t * «»n <^ s ^ . 
«*i^;t.ac c Dfiigy -f x^sa-^-ic t^mirsi^ xM^w^ramr 



a<?5/77-e««ia (R, G, B) tfiistr-&«&. a£»(c j: r ^ ^ ^ , 

^tli C <T>gC«fi, IKEE Trans. Sys . Man. Cyber. Vol. SNC-17;t 
4 1 9 87 6 2 2- 6 3 4XSezan , Yip , DalyiS<^ L/= rt^3?STl*a^^t : 

*^5yi<^i V i/s*a*/nia(»»«n:»ax'u, r^waiginQAts^ <rgb 
i«t4fcfi}-,xs^sn«w$*sflffiRj?€-*ar 5 c ttcj: -,x. itstftsns. 



(music *i) ^r-1«iSft««(cAWI(7>ftK>X-rA3 > Hr t^-r^ 

w$ t < ti. AKi^oaa=3> h-tr> >7^f trf^-f Mifcs >'»a«« 

»a«i«f£i«MJ»^^T?iicEft)*«fiEr6t*icffim*n5. z^ic. rov^r 
f*?<Da2rJi«»et«s»«>*^^t5t'^-^ (spacing) raes**'^.^ 

■r*iJCiey'J*«HJ^-*'*'^*^t^' ±X'?iffl*n/i Scott j. ony ^o*ia*5ft»^ 
No. 4. 780. 7 6 1 rciBKt* n^;.OWXGem sni , 
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if we t: L r « rr t ^ C <!: T i . 



□ ? 0T A 

H 1 2 (iSl 0 a ro'5=- ^ffi«»r«t B 1 0 b ^TX^Rftia-TtSffl * n^i Etta 
B13a.B13b.Hl3 c &Cf H 1 3 d (i. -tn^'n, Ji-v 

#i/-tEaft7T ^?EWtBl 3 cftfittf>3> h-tr > >^^ f 7^-rMJStE 



Cti%^ t---e.*r5tit4- yj^-7-<A'^16ii^5--74Jt/5'-TU"f (CF 

1^ 2 0<OS.ffi»*ffi» LX(.^-6», wo 7 ^ /U^CfiWT* 0, -t >^2 0 
>^2 0»<«±Lf;R. G, B<3!>r :^D^BftfS^tJ. ttStJlJET o r fS ^ T' 

»-G^^^. b-B^ ^^-s-iEE Lia;»-ri/:*>(c 1/ r^jtx*. r, c, 

BorSBT-f-oji^ffi^tl. r-J-arr^ J ^ ■ => f'26(--t»?^^ 
7 -rUCD r . b-y»- ^ a-ir-rh '^-ft- (8-bIt bytes ) ) E 

»#ns. ^-^ - r n -e-y -^ri^ >7'i' y 2 8 li. 5*- * ^-—t^flf^jic j< ^ >> 

2 QicttttL-r*'^, -r-^^ffWrS. f^^ -l^y Jl. • 3 0 (1, 7. 

i^'< i >/Ett3 2-riWW*ns. 

^ /t. ■ > * 'ja-^di t ^•5r-^•■r^>■/t'•7^Rcr7'o-t-)r■^^3S*<^ 

*n*. i;^^H»r&aK3 4(±, Bl(0r^-fx5A,.^:7->^3 OicI£l»S 

-t -7 3 7 icijt'^ni* tr^jf . 7*0 -tr -7 ^ 3 6 a ? - • t-7=* ■ 7= 



-f XT'U W 3 8 iCiS'i*x4'^t=?t L- > h • T'o^: -y-y 3 7 ft) Mi U " - K 
3t"— - n'p— •7''J>^'39)-iS^>n4» 

0 2 4ff t 1 2 8 o?«J^>tttt«^* ^- • "^-f Ji^^SR-cHiexsns. asaiof 

70 '30* CFA-r**). 4 Sf^ iOrt ^ - • 7 ;U5'a*rrS*cS 

5 iC^iW'Oa ft itt*)«/;-5 - • 7 -f jl/^g*fl<«-C*4 0(;ttU, 

irii. mmtz. -t Ot± 1 0 2 4 fTi: 1 2 S 0 W(^>^^aia2 0 A-C»fiE 

*ni, t3l<r) Ax'D 3 ? 26>><8 - e-^ h h 't^e)c+'« ^. lO 
2 4nt 1 2 8 0?^tf>8 C -* KliftUt >*r2 0 d^Wte L /: iB(t*^r. U^L. 

s*?Tis#woe[, *«3 0otf* htt, c F A 1 8ff>mn-uf3^~ 

s«fa<t <». rt) tisiii^fj^-s^m c^to, rssno) -cwn-r s^^j-c. 
ttfiL/iBfli*T^-#-A/D 3 1^ 2 6 jft-'i r£5aa«-f^- ^*«i^«2s ca 

5o;*f^y7'40) . B5©;^-^-:'7'41-Ct±, 7=-^ - ro-tTr^2Sd*3-3 



8 



2 9 Us crsfiJJH) H#*r>^ -e-J • 7d^74 2x/;(a-j=-7fli, 

ftmytu . -7 ^ 4 6 « w^- ffiiA'-itteE? ni. L v^^aOTTrii- 
ff B* ^ * '/ • 7" o v 4 2 I 2 8 OW^it S 7 6 SfftDS - f-y h 
h-t<rL. bS«yo:^^44RtXrBff^ov^46li64 0?'J»(tS 2 5 6 
« _ w -/ k /^-^h*-*!^*- 

x«e3Cto3E«*W!Mr & t ic -r, w^B«<D y ^ x*<A«(=«'>r s 

«^5*-rogAffl i/8^»5tu- tiTicift«flrs^ ^.feiflffea«(ir 
SWosfeifcfa*? r - g t b - « t L-rrsiW-cftW* n, ar**ns. W&-ti 
iig(w?;»iUfi*ai«feH«<^ r - g t b - g oasfs^-s-^i* u.vv c ttc^ 



^¥5-505084 (9) 

SflC. B5*ff?Bt1--£i. in{cK<WL/;^-3)C. 5^-7-^0^^-^2 8(1^ 

xfliMfe«sPf«:H-fli-ri. 3c CFA i8oTido^j'< J'- >-r«, 
i^s<ox7^ 7 r4 8) • 



«5 
«6 

T fi & ip-t^ DE ffl r i , 

««iss"* «l + Bxgj + Cxgj + Cxg, + BXg5 + Axgj 

A <• B < C 

A - .218 
B- .563 
C - ,844 

BSOXt^-tT 5 OTH, 7=-y •:?'o-by':f2S(iC F AE^Iicff ffir i * 
6<fcWfeffl«f;WLr rSfl!Iofeft«^ r - ff t b - g/fl^-tfl-WL, -taiCJ: 

s. fsitticur, •ro-trv-i-2aiisrsra'n«feSJ(ettb6-4.?*JC-riX«L 



f r - i - *• i - « ^ i diss) 
(b-«) j-bj-sb - (^jjjgj 
(BL. tr-g) . U I SSO r - g<^feaS«»«"C* , r ^ « i » § 

aiffl^n/iiicflitsfeassfteorsisiBtrs, s (b-g> jtii»9(0b- 
I setoff fea«®(jrin= ft if*Jw«iJ5*n/iXffl**i./:.«feS«^ r s 

as nxo^'iV'Uiaaifti^i^fcWtfi^n. y t v 2 9 ti rsiaHfeB^^-a^^i- 
^56i, b - g J^^'-i * 6 4 2 56*f«8-e-yh /-f-f 

he?/*'; - r o ^ ^ 5 SA-^»WfiR*ns. fe*5^- s l 
fes « r 4 ^ - y II o atflgji-r * • 

H50Xf^-/^6 1f(a, ^-^-yo-tr-yT28 (IB • T'ov^ 

5 4, 5 6, 5 SffX-n.t-ntcttttL/iT'-^ tSI* (:ff«-r6. ZKT-'^-fh 'l 
y^^t- • U3-5^3 0(1 f^- BE W^-^-t Jen r 

7BB. ta 1 <^5:^o rr 5 4 , 56, 5 8 iOr^-i^ti, 

-»'^64-C-?-^ •Tfo-fe-7lf3 5«*»fiL. Sl«>^9--T'-rffi, 
ii/*y.:yn*?54, 56, 5 8 i-*tICr SWftx - ^ t^^Et-*. -S-ro*. 
^ t^^-r:\±^ M Cg> ^ t r - g RCP b - g ^ ^-F'^Jiav 



-gac;b-g) s«*?K^P^(=f^»»9! (B607.T--/ r? 2> L, ;!tfc, «ia 

7, 7 8j»^^»<;5. 

4 8 iiS»U5?^-C35Jt*n5. B 6 <0 7K*F*Jf»»ait "f" v r 7 2 ti, (*fi^T- v 

(r-ff) J ; <r-g) (r-g) 2 - • 

(b-g) 1 : (b-g> ,(35 : (b- g) 2 : • • - 
ZZT. ST -Biss* UXflJB***r. B305C F A 1 8<04»aS«?T(C 
* 4 *r-fe t W £0 a« (^SWiC •> - >r > :z (IJaTO J: -3 
^ !• ^.iss- ' 2- ■ - • 
!• ''•Iss- ^ 2- ■ • 

B J SS fl 1 o S 

/*fi*n^ r - gacf b - g« rswf^-^t-ffl^-*^-^ xm;^ nr^rmwi 

^.iss* 5x C (r-B) J + <r-g) 2^ RCf 
*',1,B-«*>.IS5*- 5x [<b-g> 1^ (b-g) ^} 
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rj-ff,i-^ (r-a) ^ 
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H, c r -JT fw <i * ^ - .. ^- (j-.iti .» ^ * ...-^-^ 

mnntan^mia. a. 7eQ. 7 6 i tk^* nn^-s tEWftKM 
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( 30. 12. 86) . 

Ea« fl9. 1.7: column 3. line 
30 - column «. lln« 6, 
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(03. IC. 901 . 

se« f ig . 1 : coluan 3 . line 12 
- coXuM 4. lUie 3S. 

A2. 0 304 643 
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j7 - C3i-J*-«.T 5. line 4. 
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07 Ftoruary 1991 (07. 03. 91). 
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